Design choices for agent-based control of AGVs in the dough making process

In this paper we consider a multi-agent system (MAS) for the logistics control of Automatic Guided Vehicles (AGVs) that are used in the dough making process at an industrial bakery. Here, logistics control refers to constructing robust schedules for all transportation jobs. The paper discusses how alternative MAS designs can be developed and compared using cost, frequency of messages between agents, and computation time for evaluating control rules as performance indicators. Qualitative design guidelines turn out to be insufficient to select the best agent architecture. Therefore, we also use simulation to support decision making, where we use real-life data from the bakery to evaluate several alternative designs. We find that architectures in which line agents initiate allocation of transportation jobs, and AGV agents schedule multiple jobs in advance, perform best. We conclude by discussing the benefits of our MAS systems design approach for real-life applications

Opportunity costs calculation in agent-based vehicle routing and scheduling

In this paper we consider a real-time, dynamic pickup and delivery problem with timewindows where orders should be assigned to one of a set of competing transportation companies. Our approach decomposes the problem into a multi-agent structure where vehicle agents are responsible for the routing and scheduling decisions and the assignment of orders to vehicles is done by using a second-price auction. Therefore the system performance will be heavily dependent on the pricing strategy of the vehicle agents. We propose a pricing strategy for vehicle agents based on dynamic programming where not only the direct cost of a job insertion is taken into account, but also its impact on future opportunities. We also propose a waiting strategy based on the same opportunity valuation. Simulation is used to evaluate the benefit of pricing opportunities compared to simple pricing strategies in different market settings. Numerical results show that the proposed approach provides high quality solutions, in terms of profits, capacity utilization and delivery reliability

Applying revenue management to agent-based transportation planning

We consider a multi-company, less-than-truckload, dynamic VRP based on the concept of multi-agent systems. We focus on the intelligence of one vehicle agent and especially on its bidding strategy. We address the problem how to price loads that are offered in real-time such that available capacity is used in the most profitable way taking into account possible future revenues. We develop methods to price loads dynamically based on revenue management concepts.\ud We consider a one leg problem, i.e., a vehicle travels from i to j and can wait at most τ time units in which it can get additional loads from i to j. We develop a DP to price loads given a certain amount of remaining capacity and an expected number of auctions in the time-to-go. Because a DP might be impractical if parameters change frequently and bids has to be determined in real-time, we derived two approximations to speed up calculations. The performance of these approximations are compared with the performance of the DP. Besides we introduce a new measure to calculate the average vehicle utilisation in consolidated shipments. This measure can be calculated based on a limited amount of data and gives an indication of the efficiency of schedules and the performance of vehicles

Dynamic threshold policy for delaying and breaking commitments in transportation auctions

In this paper we consider a transportation procurement auction consisting of shippers and carriers. Shippers offer time sensitive pickup and delivery jobs and carriers bid on these jobs. We focus on revenue maximizing strategies for shippers in sequential auctions. For this purpose we propose two strategies, namely delaying and breaking commitments. The idea of delaying commitments is that a shipper will not agree with the best bid whenever it is above a certain reserve price. The idea of breaking commitments is that the shipper allows the carriers to break commitments against certain penalties. The benefits of both strategies are evaluated with simulation. In addition we provide insight in the distribution of the lowest bid, which is estimated by the shippers

Interaction between intelligent agent strategies for real-time transportation planning

In this paper we study the real-time scheduling of time-sensitive full truckload pickup-and-delivery jobs. The problem involves the allocation of jobs to a fixed set of vehicles which might belong to dfferent collaborating transportation agencies. A recently proposed solution methodology for this problem is the use of a multi-agent system where shipper agents other jobs through sequential auctions and vehicle agents bid on these jobs. In this paper we consider such a multi-agent system where both the vehicle agents and the shipper agents are using profit maximizing look-ahead strategies. Our main contribution is that we study the interrelation of these strategies and their impact on the system-wide logistical costs. From our simulation results, we conclude that the system-wide logistical costs (i) are always reduced by using the look-ahead policies instead of a myopic policy (10-20%) and (ii) the joint effect of two look-ahead policies is larger than the effect of an individual policy. To provide an indication of the savings that might be realized with a central solution methodology, we benchmark our results against an integer programming approach

Look-ahead strategies for dynamic pickup and delivery problems

In this paper we consider a dynamic full truckload pickup and delivery problem with time-windows. Jobs arrive over time and are offered in a second-price auction. Individual vehicles bid on these jobs and maintain a schedule of the jobs they have won. We propose a pricing and scheduling strategy based on dynamic programming where not only the direct costs of a job insertion are taken into account, but also the impact on future opportunities. Simulation is used to evaluate the benefits of pricing opportunities compared to simple pricing strategies in various market settings. Numerical results show that the proposed approach provides high quality solutions, in terms of profits, capacity utilization, and delivery reliability

An explicit Nash equilibrium for a market share attraction game

In competitive marketing, the speed of generating the best price has become as critical as its reliability. In this study, we aim to design a practical marketing management tool. We consider a non-cooperative marketing environment with multiple substitute products, where total market size is moderately price-sensitive. The price-demand relations are determined by a market share attraction model, where the attraction of each product is a linear function of its price. The product's brand image is reflected in the parameters of this linear function. For the general case of multiple substitute products, we derive explicit expressions for the best-response functions. For the specific case of two substitute products, we derive closed form expressions for the prices at Nash equilibrium. These expressions help managers in changing their marketing instruments other than price, so as to obtain substantial individual profits. We show how our closed form Nash equilibrium enables the examination of the profit loss due to competition. Relevant for practice is the fact that our model can be easily calibrated. We provide a simple procedure for estimating the model parameters

An agent-based simulation model for autonomous trailer docking

This paper presents a simulation model of a generic automated planning and control system for the pick-up and docking of semi-trailers by means of autonomous Yard Tractors (YTs) in a collision- and conflict free environment. To support the planning and control of the YTs, we propose a Multi-Agent System (MAS). We illustrate our approach using a case study at a Dutch logistics service provider. To evaluate the proposed system, we design an agent-based simulation model, which is set up in a similar way as the MAS. We conclude with the verification and validation of the simulation model

Aligning barge and terminal operations using service-time profiles.

We consider a key issue in hinterland container navigation in ports, such as Rotterdam and Antwerp, namely the barge handling problem: how to optimize the alignment of barge and terminal operations in a port. We make a major step in solving the barge handling problem for practical settings. Specifically, we consider restricted opening times of terminals, unbalanced networks, the presence of sea vessels, and closing times of containers. Consequently, at a terminal a barge faces time dependency in: (1) the waiting time until the start of handling and (2) the handling time itself. The concept of waiting profiles which we introduced in an earlier paper only deals with (1). To deal with (1) and (2) together we introduce a more comprehensive concept, namely that of service-time profile. To establish how well our approach works, we evaluate the performance of our distributed planning approach extensively by means of simulation. We compare our results with those based on centralized planning by using an off-line benchmark resembling it. We show that the Multi-Agent system that we introduce enables barge and terminal operators to align their operations efficiently. Hence, it can be seen as a promising solution approach for solving the barge handling problem, since it enables (competing) companies to collaborate in a competitive way